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1 .  Introduction 

Spectral  analyses  of  non-stationary  random  processes  are 
needed  when  analyzing  observations  of  random  phenomena  in  a 
changing  physical  environment.  A  class  of  such  processes,  which 
are  continuous  with  respect  to  a  time  parameter,  is  generated  by 
associating  a  random  component,  such  as  noise,  with  linear  or 
non-linear  trends,  periodic  components  or  a  combination  of  these. 

A  set  of  functionals  and  their  statistical  estimates  are  de¬ 
fined  for  these  time  dependent  processes  over  subintervals  con¬ 
tained  in  a  finite  interval  of  time  representing  the  duration  of 
observation.  The  mathematical  expectation  of  processes  formed 
from  the  set  of  functionals  provide  representations  for  the  co- 
variance  and  frequency  spectrum  which  have  statistically  consistent 
estimators.  These  representations  of  the  covariance  and  frequency 
spectrum  become  the  well  known  definitions  of  the  centralized  auto¬ 
covariance  and  power  spectrum  for  wide-sense  stationary  processes  when 
that  assumption  is  invoked. 
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2  Notation,  Definitions,  and  Assumptions 

2'  - -  fv  •  +  p  Tt*  t**]1 

We  define  a  continuous  parameter  random  process  (Y^tstT  , 

interval  of  observation 

to  be  strictly  non-statlonury  over  the  fin 

[T*,T«]  if  all  orders  of  the  associated  probability  distributions  are 
time  dependent  and  consequently  all  orders  of  the  defining  moments  are 
continuous  functions  of  time.  The  process  is  said  to  he  wide  sense 
non- stationary  if  at  least  the  probability  distributions  associated 
with  ihe  covariance  function  are  time  dependent.  Functionals  and  re- 

.  thpm  that  are  valid  when  the  associated  distributions 

lations  between  them  that  are 

i  4-  ora  also  true  for  time  independent  distributions, 
are  time  dependent,  are  also  true 

Thus  in  all  statements  and  proofs  »e  assume  time  dependent  distri¬ 
butions.  Further,  we  assume  that  those  orders  of  the  process  moments 

*  t p  Tt*  T**l  and  that  each  such 

necessary  for  proofs  exist  for  each  t«[T  ,T  J 

moment  is  Intertable  in  the  Biemann  sense  over  that  interval. 

Given  a  continuous  parameter  non-stationary  random  process 

(Y  ,t«tt*.T**])  and  sample  functions  y(t)  thereof,  we  form  sequences 

of  subintervals  [t'-S.t'+S]  dependent  on  a  midtime  t  such  that 

i.  Y  and  y (t )  are  considered  for  t  -T  s  t  £  t  +T,  0 

t 

and 

ii.  Y++t  and  y(v+T)  are  considered  for  t  -T  *  t  «  t  +  T, 

v+T 

Vs  s  T  £  S-T. 

-mat  is,  for  each  %'  e  we  require 

[t'-T.t'+T)  C[t/_S ,t/+S ]  C[T*,T**] 
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We  define  the  linear  random  functionals  (stochastic  integrals) 


W1') 


—  +T  Y  dt 


AT(Yt+T;t/) 


Wt+T*') 


~  +T  Y  dt 
2Tj./_T  t+T 

—  /*  +T  Y  Y  dt 
2T  '  /  t  t+T 
t  -T 


(2.1) 


to  exist  for  each  real  function  Y  of  the  process  (Y  ;te[T*,T**]) 

t  t 

where  ts[T-S,S-t]  .  The  process  moments  and  their  time  integrals  that 
we  assume  to  exist  are 


-  oo  <  EYn  <  oo 

t 

-  oo  <  EYn  <  00 
t+T 

-  oo  <  EYV1  <oo, 
t  t+T 


(2.2) 


for  nsl'2,3,4,  and 


-  +T  — « -.n  .  . 

-oo  <  J  EY  dt  <  oo 

t  /_T 

,  rt  '+T  „n  , 

-  oo  <  J  EYa  dt  <  oo 

t'-T  t+T 

-  oo  <  J1  T  ey\J  dt  <  oc 

t'-T  *  t+T 


(2.3) 


for  te[t '-T,t  /+T]  ,c[t /-S,t /+S]  c[T*,T**]  and  tc[T-S,S-T].  With  the 

assumption  that  the  linear  operations  of  mathematical  expectation  and 

> 

integration  with  respect  to  the  parameter  may  be  interchanged,  the 
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allowing  statements  may  be  made  for  the  functionals  of  (2.1) 


EAT(v’(t')  =  AT(EYjjt') 

tVYtYt*Tit')  '  AT(EYX+T;t')-  '  <2'4) 


With  these  basic  assumptions  and  definitions,  we  proceed  to  gen¬ 
eralized  definitions  for  the  covariance,  spectral  representation,  their 
estimators,  and  proofs  for  the  consistency  of  these  estimators. 

3 .  Covariance 

The  centralized  covariance  for  the  non-stationary  random  process 
{Yt;te[T*,T**])  is  defined  with  the  functionals  of  (2.1)  by 


*T(Tit')  -AT(ETtYttT;,')  -AT(EVtit')AT(EVt+Tit', 

for  tc[T-S,S-T]  and  any  subinterval  [t/-T,t/+T]  c[t/-S,t/+S) 
For  wide  sense  stationary  processes  the  definition  of  (3.1) 


(3.1) 

C[T*,T**]. 
reduces  to 


*T<T>  -  “tYt+T  - 


and  to 


MT!t')  -  *T<YtYt+Tl*')  -  AT(Ytlt')A  (Y  ;t') 


for  deterministic  processes. 

An  important  consideration  concerning  the  properties  of  the  co- 
variance  of  a  non-stationary  process  is  that  it  need  not  be  an  even 
function  of  t.  This  is  evident  when  one  considers  a  process  involving 
a  time  dependent  non-trivial  polynomial  trend.  Therefore,  unlike  wide  - 
sense  stationary  processes,  this  property  must  be  reflected  in  the  defi¬ 
nition  of  a  spectral  representation  for  non-stationary  processes. 
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4. 


A  Spectral  Representation 


Since  it  is  possible  that 

♦T('r,*ty)  ±  H-T.-t')  (4.1) 

for  TefT-S,S-T] ,  then  a  spectral  representation  for  a  non-stationary 
process  over  [t^-S.t^S]  C[t*,T**] 

$(nWS-T;t  *)  =  I  2(s-t7  ^S"T  ^T(T'*t/)cos(nws_TT)dT  I 

+  I  2'(g-TJ  /S"T  ^(Tft'JsinCnWg^TjdT  | 

T-S 

=  I  As_T[^T(T;t/)cos(nwg_TT)]  | 

+  I  AS— r r4,T (T » t '  )sin(nwg_TT )]  |  (4.2) 

where  wg_T  =  7r/(S-T).  This  spectral  representation  for  a  non- 
stationary  process  has  the  desired  properties  that 

a-  *(nws_T;t/)  s  0  for  nws_T  ^  0, 

b.  if  (4.1)  holds,  the  Fourier  sine  transform  is  non-zero  and 
is  not  neglected,  and 

c-  for  ^(Tjt7)  =  ^(“Tjt'),  the  definition  of  §(nWg_T;t ' )  is 

$(nwS-T'*t')  “  As-T^T(T;t/)  cos(nws-TT^ 

which  is  the  power  spectrum  often  stated  for  random-periodic  processes. 

In  general,  the  spectral  representation  (4.2)  no  longer  enjoys 

the  inverse  transform  relationship  with  ^(Tjt7).  The  inverse  transform 

relation  does  occur  for,  the  preceding  property  c,  i.e.,  when  the  Fourier 

sine  transform  is  zero  and  $(nw  ;t#)  is  positive  definite. 

S-T  • 
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5. 


An  Estimate  for  the  Covariance  Functional 


Assume  that  we  possess  M  independent  sample  functions  /^(t), 
m=l,2,...,M,  of  the  continuous  non-stationary  random  process 
{Y  ;te[T*,T**]) .  Then  for  all  t  on  any  subinterval  [t'-T.t'+T] 

t 

«[t'-S(t'+S]  <S[T*,T**]  and  tg[S-T,T-S] ,  the  following  expectations 
exist 


Ey  (t)  =  EY 
m  t 


Eym(t+T)  =  EYt+T 


(5.1) 


Eym^t)ym^t+T^  =  W+Y«.4.t 

mm  t  t+T 


for  each  (11=1,2,...^.  From  (2.4)  we  have 


=  ATrEym(t);t']  =AT(EYt;t/) 

EATtym(t+T);t/]  =  AT[Eyin(t+T);t/]  »  A^EY^jt') 

EATrym(t)ym(t+'r);t/]  =  ATrEym(t)ym(t+T);t/]  =  Ax(EYtYt+T;t ' )  . 

(5.2) 

Next,  we  define  an  estimate  for  the  covariance  functional  of  (3.1) 
in  terms  of  the  M  sample  functions  y^(t)  as 

WTit'>  =s  Vyi(t)yi<t+T)!t'] 
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and  observe  that  we  can  rewrite  this  estimate  as 
z  i  M 

^  =  m3  Z  {Axfyi(t)yi(t+T);t/] 

^  tJ »k-l 

-  ATfyj(t).;t/jAT[yk(t+T);t/]). 

(5.4) 

The  consistency  of  this  estimate  is  stated  in  the  following  theorem 
and  then  proved . 

2522ES1-  «  l*T(T;t')|*  <«,  for  an  tc[t '-T.t'nJ  c[t'-s,t'+s] 

ctT*,T*»]  and  all  Te[T-S,S-T],  then  E  ltm(T;t ' )  |*  <„  and 

^E|*MT(T,.t')  -  yr, =0. 


Thus  P  lim  v  (T:t')  - 
estimate  for  ^  ( t ; t 7 ) . 


+'T(T;t ')  and  hence  ^('Wt')  is  a  consistent 


Proof :  Write 

-  VTiOl*  -  EtV<Tit'>  -  V(T;t'))2 

and  let  (5.5) 

ai  =  ATtyi(t)yi(t+T)>’t'] 

bj  =  ATfyj(t>;t'3 

CJt  “  Vyk<t+T,it  )-  (5-6) 
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Then  the  term  Et^Tlt')  at  (5.5)  may  be  written  as 

‘WTit'>  =  iK,L=1Elai'  V't)  =  s1f1E(ai) 


-  i  E  E(b  c  )  -  ri  £  E(b  )E(c  ) 
M  j=l  J  J  J.k=l  J 


where 


E^Cj)  =  EtAT^yj^t^;t^AT^yj^t+T^t  ^ 


£  A  [Ey*(t);t']  +  AT[Ey*(t+T);t  ] 
T  J 


Then  by  (3  . 1 )  and  (5.2;, 


(5.7) 


Et_(T;t')  *  *T(T;t')  -  i  Ut(EV>  +  EYttTit')  -  yEYtit')AT(EVt+Tit  )|. 
MT  1 

But  by  (2.3)  there  exists  a  positive  number  kt  <  ~  such  that 
|at(EV=  +  EVj+T!t')  -  AT(EYtit')AT(EVttTit')l  *  E, 

for  all  t't[T*,T**J  and  all  Tt[T-S.S-T).  Therefore 

EVTit,)  2  VT|t,)  "ts1  .  <5,7> 

Similarly  the  term  E^(T,t')  of  (5.5)  may  be  calculated  from 

«*,<*•*'>  ■  P  ,  “i  ‘  Ve)!!  P  ^  (“m  -  V,>» 

=  4  s  E[(ai  -  bjCk)(am  -  bncp)] 

M  i , j ,k,m,n,p=l 

■  p  ,L  -  v  +  *  J.h!„,^iCkb"Cp) 
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Then  by  (3.l)  and  (5.2) 


E»St<T“'>  S+i+H[AT(BYJ+EyJ+T*t,)] 

where  K  =  f(M“l,M-a).  Therefore,  by  (2.3),  there  exists  a  positive 
number  ka  <  00  such  that 

k[at(eyJ  +  EYj+T;t#)]  5  k2 

and  hence 

tr*  tlr2  f  a*  •  4-  *  ^  ^  1 

ttji  ^ 


E*w(Tit,)  *  *?(Tft,)  +  1 


M 


(5.8) 


Substituting  (5.7)  and  (5.8)  into  (5.5) 

-  UTI*')I’  *  +T(Tlt,)  +  ^  ‘  2*J(T!t,)  *  ^  V’’*'1 


+  *“(TSt ')  *jjj  (k2  +  2k1*fp(T;t')] 


Since  it  was  assumed  that  UT(T;t  )|  <  »,  then 

Lim  e||  (T;t')  -  'L(T»t')|2  =  0 

M-*»  MT  l 

i 

for  .11  t€[t'-T,t'+T]  C[t'-S,t'+S)  c[T*,T*»)  and  all  Tc[T-S,S-T] . 

6.  An  Estimate  for  the  Spectral  Representation 
Let 

VnWS-T;t/)  =  lAS-TrV(T;t/)COS(nWS-TT)]l 

+  lAS-T[  '  >sin  (nwS-TT)3  I 

be  an  estimate  of  the  spectral  representation  $(nwg_T;t  )  as  given 
by  (4.2).  For  $M(nws_x!t< )  to  be  a  consistent  estimate  of  $(nwg_T;t  ), 


we  show  that 


{S^V-w')  -  »("vT.-t')i2  -  o 


Consider 

l$M(nWS-T;t^  "  *(nwS-T»,t#)l  "  nAs-T[W(T;t^cos(nVTT)3l 

+  KvVT;t,)sin(nvTT)Jl 

“  lAs-T[’1'T(T;t/3cOS(nws-TT33  I 
“  lAs.TfVT;t/)sin(nYTT)]|l 

lAS-T^  ^MT^T;t  3  “  1^T(Tit/)fcos(nw  T)}  J 

S-T 

+  ^AS-T^W^T;t  3  “  ^'T(T»t '  J]sin(nw  t)J  J 

1  o-T 

S2  'WlWT!t')  - 

Taking  the  mathematical  expectation  of  the  square  of  each  side  of  this 
inequality  yields 

*IV"Vp**')  -  ‘("w4')!*  ‘ 4  ^tlv^')  -  ♦jtTitjhj 

* 

By  Schwarz’  inequality 

As-Tf  ^MT(T;t  3  "  V^-Oh  SAs-T[IWr,t#)  "  ^T(T;t  ^  I2J  J 
and  thus  we  conclude  from  (5.10)  that 

£rlVnVT;*'>  -  ‘  As.T[E|V(T;t')  -  *  (T,t')hj 


S4  AS-Tr“"  El*MT(T;t')  -  ♦T(Tit<)|*]  =  0. 


Therefore  P  Lim  $  (nw  •+/^  _  j>/„  ,  / .  ,  ,  , 

M->oo  S-Tft  ‘  “  ^nVT;t  3  and  $M^nWS-T;t  3  is 

consistent  estimate  of  the  spectral  representation  $(nw  it') 

'  S-T ’  ’ ' 


a 
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7. 


Conclusions  and  Remarks 


A  set  of  functionals  and  their  consistent  estimators  have  been 
developed  for  the  speetral  analysis  of  continuous  pon-stationary 
random  processes.  The  methodology  is  suitable  for  analysis  of  dis¬ 
crete  parameter  non-stationary  processes  by  using  appropriate  sum¬ 
mations  in  lieu  of  integrations.  The  methods  were  developed  to 
analyze  modulation  frequencies  in  radar  returns  from  space  vehicles 
re-entering  the  earth's  atmosphere.  Good  agreement  is  obtained  be- 
tv’cen  the  spectral  content  of  the  radar  returns  through  the  use  of 
these  methods  with  data  from  other  sensors.  The  method  is  most 
useful  in  determining  spectral  information  from  those  processes 
whose  frequencies  ehange  with  time. 
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